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Social advertising uses information about consumers' peers, including peer affiliations with a brand, prod- 
uct, organization, etc., to target ads and contextualize their display. This approach can increase ad efficacy 
for two main reasons: peers' affiliations reflect unobserved consumer characteristics, which are correlated 
along the social network; and the inclusion of social cues (i.e., peers' association with a brand) alongside ads 
affect responses via social influence processes. For these reasons, responses may be increased when multiple 
social signals are presented with ads, and when ads are affiliated with peers who are strong, rather than 
weak, ties. 

We conduct two very large field experiments that identify the effect of social cues on consumer responses 
to ads, measured in terms of ad clicks and the formation of connections with the advertised entity. In the first 
experiment, we randomize the number of social cues present in word-of-mouth advertising, and measure 
how responses increase as a function of the number of cues. The second experiment examines the effect of 
augmenting traditional ad units with a minimal social cue (i.e., displaying a peer's affiliation below an ad in 
light grey text). On average, this cue causes significant increases in ad performance. Using a measurement 
of tie strength based on the total amount of communication between subjects and their peers, we show 
that these influence effects are greatest for strong ties. Our work has implications for ad optimization, user 
interface design, and central questions in social science research. 

Categories and Subject Descriptors: J.4 [Social and Behavioral Sciences]: Sociology; J.4 [Social and 
Behavioral Sciences]: Economics; H.1.2 [Models and Principles]: User/Machine Systems 

General Terms: Measurement, Experimentation, Human Factors 

Additional Key Words and Phrases: Online advertising, peer effects, social networks 

1. INTRODUCTION 

Socia l media activity now constitutes a substantial fraction of time spent on the 
Web [ |Goel et al. 2 012 1. Users of social networking technologies create explicit repre - 
sentations of their relationships with other users (their peers) [boyd and Ellison 2007 1, 
and use those connections as channels for information dissemination. They also estab- 
lish conn ections with o ther entities in order to express their identities and subscribe to 
content [Sun et al. 2009 1 . The widespread adoption of such technologies has led to ad- 
vertising approaches that differ from existing approaches, such as search-based adver- 
tising. For example, rather than inferring consumer intent via search terms, social ad- 
vertising systems can match ads to consumers who h ave peers that are affiliated w ith 
the brand, product, or organization being advertised | Hill et al. 2006 Tucker 20121. 
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Social advertising systems can also display social context about peers who are af- 
filiated with the entity being advertised. These social cues create a channel for con- 
sumers to influence one another. Like word-of-mouth (WOM) and "viral" marketing 
approaches, advertisers employ social ads with the goal of spreading attitudes and 
behaviors through consumers' social networks. Thus, many of the central research 
questions in WOM research apply to social advertising, and research on social adver- 
tising can contribute to the broader understanding of social influence in the behavioral 
and economic sciences. In particular, studies of social advertising can be used to learn 
about how consumer responses depend on (a) the number of social signals that con- 
sumers receive from their peers (b) the characteristics of the relationship between the 
consumer and their peers. The present research addresses both of these topics. 

Despite the similarities between WOM marketing and social advertising, there are a 
number of important qualities that distinguish the two. First, a minimal, "lightweight" 
consumer behavior (e.g., creating a connection with an entity) is sufficient to make 
that consumer a source of peer influence . Second, social influenc e via these systems is 



passive and automatically targeted (cf. |Aral and Walker 20111). That is, once an in- 
dividual creates a persistent connection with an advertised entity, social influence can 
occur continually without additional actions, such as sharing messages with others. 
Finally, social advertising allows stakeholders to play a more active role in creating 
and funding ad campaigns with specific text, images, or video. 

We regard social advertising as any advertising method that uses information about 
consumers' social networks to target ads and/or provide personalized social signals. 
Thus, there are two ways in which the use of social information in advertising can af- 
fect consumer responses: social networks encode unobserved consumer characteristics, 
which allow advertisers to target likely adopters; and the inclusion of social cues cre- 



ates a new channel for social influence. Recent work on social advertising (e.g., [Tucker 
|2012) ) has recognized these mechanisms, but has been largely unable to identify the 
the extent in which social influence actually plays a role. As far as we know, the present 
research is the first to identify the effect of social signals from peers on consumer re- 
sponses to advertising. We use field experiments to make this identification possible. 

1.1. Overview 

We investigate the effects of social cues in online advertising using two very large 
field experiments that randomize the number of social cues present in ad units on 
Facebook. Experiment 1 examines the marginal effect of referring to additional peers 
in word-of-mouth-type ad units. We identify the average dose-response function (more 
specifically, the cue-response function), for one to three peers, whose shape and slope 
differs substantially from naive estimates derived from observational data. We find 
that, consistent with the expectation that social cues are a channel for positive peer 
effects, showing more peers affiliated with the advertised entity can increase positive 
consumer responses. 

Having established the presence of substantial social influence effects, we extend 
this analysis to minimal social cues about a single peer. Experiment 2 manipulates 
whether ads include a reference to a single peer or a visually commensurate control 
message. Even this minimal cue — mentioning a single peer — can cause substantial 
increases in clicks and the creation of connections with the advertised entity. Finally, 
we examine how consumer responses vary with the strength of the relationship be- 
tween the consumer and affiliated peer, as measured by past communication behavior. 
Our results show that those with stronger ties who are affiliated with the advertised 
entity are more likely to respond to an ad, even if no cue is given. Furthermore, the 
presence of the cue for strong ties can generate larger influence effects compared to 
those with weak ties. 




(a) (b) (c) 

Fig. 1. Causal relationships in consumer responses to advertising. Solid lines indicate cause-and-effect 
relationships. Dashed lines indicate that variables are correlated in some (possibly unknown) way. (a) Re- 
sponses are caused by observed and unobserved individual characteristics, (b) Responses may be correlated 
with peers' responses even when there is no social influence, (c) Responses can be explained both by social 
influence and correlation among peer characteristics. Here one mechanism for social influence, among other 
possible mechanisms, is the inclusion of social cues, Dij a , along an ad. 



Before reporting on these experiments, we describe the causal relationships that we 
aim to distinguish and estimate, and we review some additional related work on online 
advertising and social influence. 

2. CAUSAL RELATIONSHIPS IN SOCIAL ADVERTISING 

At a basic level, an advertisement is a stimulus designed to encourage an individual 
to engage with an entity, such as a brand, product, movie, musical artist, organization, 
etc. The efficacy of an advertisement, typically given in terms of a click-through rates 
or conversion rates, can depend critically upon the relationship between the entity and 
the characteristics of the consumer, which may include both stable traits and transient 
states (e.g., demographic characteristics and recent user activity). 
The causal modeQof this scenario (illustrated in Figure la I is relatively simple: a 



user i has some set of known features X t , which affect the response^] Y ia to the ad- 
vertisement a. Errors in predicting the response can be regarded as resulting from 
unobserved characteristics Ui of the user. 

2.1. Predictive aspects of social information 

Many characteristics, attitu des, and behaviors are clustered in social net- 
works [McPherson et al. 2001 1; that is, "birds of a feather flock together". This cluster- 
ing has multiple causes, including individuals preferring to associate with similar oth- 
ers (preference homophily), opportunities for forming and mai ntaining relationships 
that are biased towards similar others (structura l homophily) [Kossin ets and W atts 
2009 |Currarini et al. 2009[ |Currarini et al. 20 10 1, external causes whose effects are 
localized in the social network, and prior peer influence by which peers become more 



1 We presen t causal models in this section by drawing graphs consistent with the causal framework in 
Pearl [2009; |. Our discussio n of confounding of homophily and influence follows a more general treatment by 
Shalizi and Thomas [201l) . 

' Yi a is the response to a specific ad a, including the ad creative. This allows, for the sake of simplicity, not 
including variables related to the ad creative or advertised entity. 



similar over time | Lewis et al. 2011 1. For simplicity, we subsequently use homophily to 
refer to all observed prior clustering of consumer features. 

The presence of homophily in social networks suggests that characteristics of an in- 
dividual can be predicted via characteristics of her peers0 Figure lb illustrates how 
a peer's response to an ad is predictive of a consumer's response, even if information 
about one peer's behavior is not observed by and cannot affect the consumer (i.e., in 
the absence of peer influence). Here and X are observed characteristics of the 
consumer and her peer, and Ui and Uj are unobserved characteristics. Homophily im- 
plies that these variables will be correlated in some way. Therefore, a peer j's behavior 
at a previous time Yj a (t ) is informative about the consumer i's subsequent behavior 
Y ia {ti). Furthermore, individuals who interact frequen tly exhibit greater corre lation 
among characteristics compared to those who do not [McPherson et al. 20011. This 
suggests that those who have more opportunity to influence one another may also be 
expected to respond to an ad in the same way, even in the absence of social influence. 

2.2. Peer influence and confounding 

Peer behaviors can also influence consumer responses to ads. At least since early psy- 



chological experiments on conformity to group behavior [Sherif 1936; Asch 19561 and 
observational studies of opinion leadership in mass communication [Katz and Lazars 



feld 19551, these peer effects have been a central subject for the social and economic 
scienceso 

In the presence of peer effects, an individual's response to an ad will be associated 
with their peers' responses not only because of homophily, but also because peer be- 
havior causes individual behavior. In particular, if consumers can observe or infer the 
responses of their peers, then they are expect ed to use this in formation, even auto- 
matically and outside of conscious awareness [Tanner et al. 2008], to determine their 
response. Ads that include such information about peer behaviors (i.e., as social cues) 
are expected to affect consumer responses via these social influence processes. 
The presence of peer effects, including those via social cues in ad interfaces, is il- 



lustrated by Figure lc The peer's response to the ad Y ja (t ) can affect the consumer's 
response to the ad Y^Xti) via multiple mechanisms. Of principal interest here is social 
influence via social cues, Yj a (t ) -> D lja -> Y ia {t\), although it is important to note 
that previous interactions between i and j, given by Y ia (t ) -> Y ia (ti), may also cause 
influence effects in the absence of cues. 

This picture highlights the difficulty in determining whether a change in responses 
to ads is due to the presence of social cues, other forms of social influence stemming 
from prior interaction, or the correlation in behaviors induced by homophily. For exam- 
ple, even if one were to control for all observed characteristics Xi and X 3 , it is expected 
that there are unobserved characteristics Ui and Uj that make the responses of i and 
j dependent. 

2.3. Identification via experiments 

Randomized experiments are the gold standard for causal inference [Rubin 1974], and 
the identification of peer effects is no exception. When they are possible, fie ld experi - 
ments combine this internal validity with external validity [Shadish and Cook 20091. 
Conventional experimental methodology for online advertising randomly assigns users 



3 Note that even if observed characteristics are incomplete or noisy, peer characteristics can still be pre- 
dictive. For example, Backstrom et al. [2010 1 improve estimates of the location of individuals by using the 
location of their Facebook friends. 

4 Economists some times refer to peer effects as "social interactions" |Durlauf and Io annides 2010 Manski 
[2000} Moffitt 2001). 



to a treatment group which sees an ad and a control or "holdout" group that does not 
see an ad; the experimenter the n compares the outcom e variable of interest (such as 
purchases) for these two groups [Lewis and Reiley 2008 1 . 

In the context of measuring peer effects in social advertising, experimenters can 
randomly assign user-ad pairs to receive varying numbers of social cues. For example, 
when a user views an ad which can display a social cue, whether that social cue is 
actually displayed would be determined by random assignment. In the causal model 
of Figure [lj;, this amounts to random assignment of the values of Dij a . Experimenters 
can then compare response rates of user-ad pairs assigned to different social cue con- 
ditions. The remainder of this paper focuses on experimental comparisons of this kind. 

3. RELATED WORK 

Online networks are focused on sharing information, and as such, have been stud- 
ied extensively in the context of information diffusion. Large-scale observational stud- 
ies explore a variety of diffus ion-like phenome na in contexts including the app arent 
spread of links on blo gs ||Adar and Adamic 2005| and Twitter [Baks hy" et al. 2011), the 
joinin g of groups [Backstr om et al. 2006) , product recommendations [Lesko vec et al. 
2006 1, and the adoption of user-contributed content in virtual economies [Bakshy et al. 
2009 |. Data from these studies are highly suggestive of social influence: the probabil- 
ity of ad opting a behavior increases w ith the number of ad opting peers. However, as 
noted by Anagnostopo ulos et al. [2008| and [Aral et al. [200 9], such studies c an eas- 
ily overestimate th e role of influence in online behavior because of homophily. Shalizi 
and Thomas [20111 go further to illustrate that statistical methods cannot adequately 
control for confounding factors in observational studies without the use of very strong 
assumptions. 

Some recent work has used field experi ments to exam ine effects of social signals 
in online advertising and similar settings. Tucker [2012] estimates combined effects 
of social targeting and social cues in ads and highlights the value of distinguishing 
them. Two other recent experiments are similar to the present work in t hat they ma- 
nipulate particular mechanisms of social influence. Aral and Walker [2011] randomly 
assign individuals to versions of an application that included or lacked viral market- 
ing features. Their "passive broadcast" feature has similarities to social advertising 
in that it is visible to peers and includes a social cue. However, their experiment ma- 
nipulated whether an individual's adoption of the application would notify their peers, 
rather th an whether individu als' with adopter peers were exposed to the broadcasted 
message. Bakshy et al. [2012] randomize exposure to particular links shared by peers 
on Facebook and found that individuals were more likely to share the same links as 
their friends, even if they did not see the links on the site. This tendency was stronger 
for users who had multiple sharing friends, or a single friend who was a strong tie. 
Since this experiment either completely allowed exposure or prevented it for each 
individual-link pair, it did not identify the effect of influence via social cues. 

4. SETTING AND DATA ANALYSIS PROCEDURES 

We conducted two large field experiments on Facebook during a short period in 2011. 
This section introduces the relevant aspects of Facebook and some general character- 
istics of the data common to both experiments. 

4.1. Subject experience 

A primary mode of interaction on Facebook occurs through News Feed, where users 
share with and consume content from their network of peers. Activity along these 
channels are called stories, and include short messages, links, photos, and other con- 
tent. Ties between users are established by one user requesting to become friends on 



Facebook, and the other user accepting the request. In this paper, we treat a user's 
friends as constituting their set of peers. 

Users can also establish connections with other entities by liking particular pages, 
which correspond to businesses, organizations, products, movies, musical artists, 
celebrities, etc. The liking affiliation is generally visible to the user's peers when they 
visit the user's profile and in peers' News Feeds. This latter case includes connection 
stories that indicate a user has liked a particular page. Additionally, content shared 
by a page appears in News Feed for users who like that page. 

Several different types of ad units may be present in the right hand column of the 
site. Many ad units are associated with particular pages. These units can be targeted 
toward users with peers who like the page (i.e., social targeting) and display these 
peers alongside the ad unit (i.e., social cues). For a given user-ad pair, the affiliated 
peers are all peers who like the page and are eligible to be mentioned (e.g., the peers' 
personal settings allow displaying this information to the user). 

Experiments 1 and 2 use two different types of ad units (described in Section [5] and 
Section^. In both cases, clicking on the ad unit takes the user to the advertised page. 
Clicking on a link labeled "like" — either in the ad unit itself or on the linked page 
— creates a new connection between the user and the page. We study effects of social 
cues on two responses: clicks on the linked content and liking the advertised page. 



4.2. Assessing variation in response rates 

The observed outcomes — responses to ad impressions — are not independent and 
identically distributed (IID). Users and ads vary in their response rates, and users 
only occur in combination with a limited number of ads; that is, the responses arise 
from a data-generating process with unbalanced crossed random effects of users and 
ads. Statistical methods that assume IID data neglect this dependence structure and 
are expected to be anti-conservative (i.e., produce confidence intervals that are too nar- 
row). For example, if one observed 100,000 impressions for 10,000 users and 1,000 ads, 
methods that treat 100,000 as the relevant N will generally substantially overstate 
confidence about response rates. To address this issue, all statistical inference in this 



paper employs a bootstrap strategy for data with this crossed structure [Brennan et al 



1987 Owen 2007 1. We now briefly describe our use of this strategy so that readers can 



appropriately interpret our results and apply the method to similar problems. 

In the standard (IID) bootstrap, the analyst constructs R bootstrap replicates by 
sampling N observations, with replacement, from a full dataset of size N. For each of 
these R replicates, one computes the statistic of interest (e.g., a ratio of proportions). A 
simple method for computing a 95% confidence interval for that statistic is to use the 
2.5 and 97.5 percentiles of the resulting R statistics; this is the bootstrap percentile 
confidence interval. 

This standard bootstrap procedure is not appropriate for dependent data, such as in 
our experiment, where users and ads are depende nt. Instead, analysts should resam- 
ple both users and ads independently [Owen 20071. We use a variation of this strategy 
that is suitable for online and distributed computation (Owen and Eckles 2012 1. Rather 
than resampling N observations, the data is re-weighted according the the following 
procedureFjFor the rth replicate, each user is assigned a Poisson(l) draw, and each ad 
is assigned a Poisson(l) draw. Each user-ad pair is then assigned the product of the 
corresponding draws as its weight. This strategy is known to be conservative when 
estimating the variance of means (i.e., it produces 95% confidence intervals that in- 



5 Software implementing the multiway bootstrap in R is available at https://github.com/deaneckles/ 
multiway .bootstrap The results in this paper were produced by similar software for Apache Hive. 
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Fig. 2. Experimental treatment for sponsored story ad units in Experiment 1. Figure illustrates the three 
possible treatment conditions for users with three peers (Zi a = 3) who are affiliated with the sponsored 
page, (a) D ia = 1 (b) D ia = 2 (c) D ia = 3. 



elude the true mean more than 95% the time). Throughout, we report 95% bootstrap 
percentile confidence intervals using R = 500. 

5. EXPERIMENT 1: INFLUENCE OF MULTIPLE PEERS 

Theory suggests that individuals are more likely to adopt actions previously taken by 
their peers when mult iple social signals are present [Schelling 1973; Granove tter 1978| 
Centola and Macy 2007]. These models are central to our understanding of information 
diffusion processes an olform the basis for the formal analysis o f viral marketing [Watts 
|and Strogatz 1998||Kempe et al. 2003[ [Watts an d Dodds 2007]. However, as explained 
earlier, homophily and other factors obscure the true shape and magnitude of such 
dose-response functions in real-world data. 

We use sponsored story ad units (Figure |2|) to understand the marginal effect of so- 
cial signals on consumer behavior, above and beyond what one might expect due to ho- 
mophily and other sources of heterogeneity. Sponsored story ad units resemble organic 
stories that appear in the News Feed when a peer likes a page. Similar to conventional 
WOM approaches, the story does not include an advertiser-generated message, and 
must be associated with at least one peer. The main treatment unit is therefore the 
number of peers shown. Since the ad units are essentially sponsored versions of or- 
ganic News Feed stories, they follow the same visual constraints imposed by the News 
Feed: they must feature at least one affiliated peer, and a small version of the first 
peer's profile photcj^Jis displayed in the leftmost part of the unit. The first peer's name 
may be followed by the names of up to two other affiliated peers. A small thumbnail 
version of the page's profile image is also displayed. 

5.1. Sampling and assignment procedure 

The first experiment applies to a simple random sample of all Facebook users. All spon- 
sored stories displayed to users in this sample were subject to the following assignment 
procedure to determine the number of peers to be mentioned. 

User-ad pairs (i, a) are randomly assigned to a number of peers D ia to be mentioned 
in the sponsored story. Since the maximum number of peers shown is limited by the 
number of affiliated peers Z ia (i.e., peers who have liked the advertised page and are 
eligible to be mentioned), user-ad pairs are assigned with equal probability to all of the 
possible values of D ia e {1, min(Z ia , 3)}. We limit our analysis to user-ad pairs with 
one, two, or three available peers (Z ia < 3). Experimental assignment is a deterministic 
function of user-ad pairs, so all impressions for a user-ad pair have the same number 
and order of peers mentioned in the sponsored story. In total, Experiment 1 includes 
23,350,087 users, 148,606 ad IDs, and 101,633,907 distinct user-ad pairs. 



6 Users select their own profile photo for the thumbnail. This is used throughout the site accompanying the 
user's stories and comments. 
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Fig. 3. The average cue-response function is the relationship between the number of peers shown, D, and (a) 
click-through rate and (b) like rate. Within-panel differences are caused by the treatment (number of cues), 
and are significant with p < 0.005. Error bars are 95% bootstrapped confidence intervals. Note that because 
some of the same users and ad IDs contribute to each response rate, overlapping intervals do not indicate 
non-significance of associated differences and ratios. Panels represent different populations of user-ad pairs, 
where the user has Z = 1, 2, or 3 affiliated peers. All probability scales are normalized by the smallest point 
estimate in the plot. 



5.2. Average cue-response function 

We first examine the average cue-response function, which shows how response rates 
vary as a function of the number of peers shown. This relationship, conditional on the 
number of affiliated peers, is shown in Figure [3] Panels with Z = 2 and Z = 3 illustrate 
the causal effect of showing multiple peers on click and like rates. For user-ad pairs 
with two affiliated peers, displaying a second peer caused a 10.3% (CI = [8.7%, 11.9%]) 
relative increase in click rate and a 10.5% (CI = [8.4%, 12.4%]) relative increase in 
like rate. When there were three affiliated peers, this increase was slightly weaker: 
the click rate increased by 8.0% (CI = [5.7%, 10.3%)] and like rate by 8.9% (CI = 
[6.0%, 12.1%]). 

The cue-response function can also be used to examine whether influence appears 
to follow simple contagion, where each additional cue is ex pected to cause a constant 



or slightly sub-linear increase, or complex contagion (i.e. [Schelling 1973} |Granovetter 
1978 |Centola and Macy~2 007 |), whereby additional social signals result in a super- 



linear increase in the response. We find that there is no statistically significant differ- 
ence between the probability increase from D = 1 to D = 2, and D = 2 to D = 3 (p > 0.1 
for clicks, p > 0.3 for likes). This is consistent with simple contagion, although since 
we only measure average effects, it is difficult to entirely rule out complex contagion. 

It is also apparent from Figure [3] that response rates increase with the number of 
affiliated peers, even when users only see a single cue. This trend illustrates how in 
many observational settings, the relationship between an individual's behavior with 
the number of peers who also exhibit that behavior may not reflect increased levels of 
influence. While homophily is an obvious cause of the increase in response rates, the 
difference should not be attributed to homophily alone. For example, consider varia- 
tion in the network-wide popularity of pages: sponsored stories associated with pages 
with more connected users will be observed more frequently with a larger number of 
affiliated peers. If these more popular pages have sponsored stories with higher re- 
sponse rates, then this will contribute to the between-panel differences in Figure [3] 
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Fig. 4. The two treatment conditions for social ads in Experiment 2. Subjects who are to be exposed to ads 
with at least one affiliated peer are randomly assigned to see either (a) general information about the total 
number of affiliated individuals (D; a = 0) or (b) a minimal social cue featuring one affiliated peer (Di a = 1). 



Likewise, users with more peers will be observed more frequently with a larger num- 
ber of affiliated peers. These users might be expected to differ in their response rates. 
Finally, the selection of which stories to display to a user is endogenous: an individual's 
characteristics are used to predict click-through rates, which cause the story to be dis- 
played, but these characteristics may also be correlated with the number of affiliated 
peers. Thus, unlike comparisons given by the average cue-response function (within 
panel comparisons), variation between users with different numbers of affiliated peers 
cannot be given a straightforward interpretation. 

Two limitations of this experiment concern the nature of the particular ad unit used. 
First, since this unit consists of reporting the connection of one or more peers with the 
entity, it was not possible to examine the effect of social cues relative to a baseline 
without any cues. Second, as the number of peers shown increases, so does the height 
of the ad unit and number of non- white pixels in the ad unit. While this change is very 
small relative to the overall size of the unit, this is a potential confound with the effects 
of increasing the number of peers referred to in the social cue. Both of these limitations 
motivate the design of Experiment 2, in which we examine how a more minimal social 
cue affects consumer responses. 

6. EXPERIMENT 2: INFLUENCE OF MINIMAL SOCIAL CUES 

The next experiment examines the presence of minimal social cues with an ad. In 
particular, we measure the effect of adding light grey text with the name of a single 
peer associated with the entity being advertised. Thus, the first goal of this experiment 
is to identify the effect of having a cue alongside an ad. We test whether the social 
influence effects in Experiment 1 extend to the presence or absence of any social cues 
when these cues are visually commensurate with one another and subordinate to an 
advertiser-created message. 

The second experiment also enables us to examine how the effect of social cues in 
advertising varies with the strength of the relationship between a consum er and af- 
filiated peer. Previous work mo tivates the hypothesi s that both homoph ily [Hill et al. 
2006; Kossinets and Watts 20091 and social influence [Hovland and Weiss 1951; Rogers 
and Bhowmi k 1970( |Groethals and Nelson 19731 should cause peers with stronger re- 
lationships to have responses that are more correlated. We expect response rates to be 
higher for user-ad pairs where an affiliated peer is a strong tie rather than a weak tie. 
This effect should exist even in the absence of a social cue, but we also expect that the 
effect of a social cue will be larger for strong ties than weak ties. 

Experiment 2 manipulates social cues alongside a social ad unit, which includes 
advertiser-specified "creative" consisting of a title, image, and caption (Figure [4V Be- 
neath the custom creative is a link that says "Like" and gives information about people 
who like this page in small gray text. If a user has any affiliated peers, the name of 



one of those peers can be displayed. If a user has no affiliated peers, the total number 
of users who have liked the page is displayed. 

6.1. Sampling and assignment procedure 

The procedures for Experiment 2 are the same as Experiment 1. The experiment dif- 
fers in that it involves random assignment to the presence or absence of a social cue 
(Figure ffl, rather the number of peers referred to in an always-present cue. That is, 
user-ad pairs (i, a) are randomly assigned to the presence of a social cue mentioning a 
single peer (D ia = 1) or to the absence of a social cue (D ia = 0). In the latter case, the 
total number of users who like the page is displayed in the same location and typeface 
as the peer's nameQAs before, the selection of the treatment and peer is determinis- 
tic, so users assigned to the D ia = 1 condition will always see the same peer. In total, 
Experiment 2 includes 5,735,040 users, 1,155,178 ads IDs, and 137,505,771 user-ad 
pairs. 

6.2. Average effect of a social cue 

We begin by estimating average effects of the minimal social cue. Figure [5] displays 
response rates with and without the minimal social cue for different numbers of affili- 
ated peers. Similar to the previous experiment, comparisons across different numbers 
of affiliated peers (i.e., between panels of Figure [5]) show that response rates increase 
when more peers are available, regardless of how many were shown. As before, it is 
assumed that this increase results from homophily and heterogeneity in ad-user pairs 
that are associ ated with the number of affiliated peers available to a user for a given 
ad. (see Section [5721 above) ■ 

Average peer effects resulting from the minimal social cue are identified by compar- 
ing responses with and without the social cue for each number of affiliated peers. We 
find that, depending on the number of affiliated peers, the cue increases click rates by 
3.8% to 5.4% and like rates by 9.6% to 11.6% (Figure [6}. For example, for users with 
a single affiliated peer, referring to that peer increases the click rate by 5.2% (CI = 
[4.0%, 6.5%]) and the like rate by 10.3% (CI = [8.4%, 12.3%]). This provides evidence 
that even a minimal social cue can substantially affect a consumer's response to an ad. 

6.3. Tie strength 

To what extent do consumer responses to an ad depend on the nature of the relation- 
ship between the user and her affiliated peer? The preceding analysis treats relation- 
ships among consumers as binary, where a tie is either present or absent. We now 
examine the strength of a consumer's relationship with her affiliated peers on a many- 
valued scale. To do this, we consider cases in which users have exactly one affiliated 
peer who was either shown or not shown (i.e., those user-ad pairs featured in the first 
panel of Figure [5). 

6.3.1. Measure of tie strength. We use a measure of tie strength based on the frequency 
in which two users communicate with each other via Facebook. The total number of 
comments and messages created by a user during this 90 day period is their total 
communication count C t .. We measure the strength of the directed tie between user 
i and user j as W V] — Cy/C{.. We define tie strength as the fraction of user i's com- 
munications that are directed at user j or on posts by user j. Similar measure s are 
good predictors of standard measures of interpersonal trust [Burke et al. 2011] and 



7 The Di a = stimuli can also be regarded as including a social cue, though not a personalized social cue 
about peers. Compared with non-informative text in this location, we might expect that ad efficacy will be 
higher with this general prevalence information. In this case, Experiment 2 underestimates the effects of 
having a minimal social cue. 
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Fig. 5. Average cue-response function for subjects shown no peers (D = 0) or one peer (D = 1), when 
subjects have 1, 2, or 3 peers that can be associated with the advertisement. Within panel differences reflect 
differences in the treatment condition and are significant with p < 0.005 for both click and like rates. 
Error bars are 95% bootstrapped confidence intervals. Note that because some of the same users and ad 
IDs contribute to each response rate, overlapping intervals do not indicate non-significance of associated 
differences and ratios. 
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Fig. 6. Relative increase in responses from including the minimal social cue. Error bars are 95% boot- 
strapped confidence intervals. 



selection of peers as "top friends" [Kahanda and Neville 2009]. Recent studies of infor- 
mation consumption fBackstro m et al. 2011[ and diffusion have also used this measure 
[Bak shy et al. 2012) . 

Because the validity of our tie strength measure requires that the user communi- 
cates via Facebook during the 90 day period prior to the experiment, we restrict our 
analysis of tie strength to users who fall in the middle of the distribution of total com- 
munication count Cj.; in particular, all users in this section fall within the 25th and 
75th percentiles of the count distribution. In addition, we use a percentile-transformed 
total communication count q{Ci.) as a covariate that measures how much user i uses 
Facebook messages and comments to communicate. 



6.3.2. Model. In order to pool information across similar values of tie strength and to 
facilitate statistical inference, we model responses to ads using logistic regression with 
natural splines. We fit a model in which ad clicks are predicted by the presence of a 
minimal social cue D ia for user i and ad a, measured tie strength Wij for user i with 
the affiliated peer j, and the user's percentile-transformed total communication count 
q{Cu). This model includes interactions of the minimal social cue with tie strength and 
with total communication count. 

In particular, the model is specified as 

Y ija ~a + SD ia + Tf(Wij) + riDia-ftWtj) + 79(Ci.) + M{Cu)- f{Wij) (1) 

where / is a natural spline basis expansion for measured tie strength with knots at 
the second and third quartiles of measured tie strength over all impressions. We fit the 
same model to the data for the response of liking the page0 

6.3.3. Results. Response rates increase with tie strength both in the presence and 
absence of social cues. Figure [7J shows predicted response rates for user-ad pairs as 
a function of tie strength with (solid) and without (dashed) the minimal cue]j Since 
response rates vary with total communication count, we plot the results for users at 
the median of the total communication count, C,.. The increase of response rates in 
both conditions is consistent with the expectation that social influence, homophily, and 
other sources of heterogeneity should all produce increased correlation in responses 
among strong tie peers compared to weak tie peers. 

If influence is greater for strong ties, then we should expect the increase in response 
rates that results from the display of social cues to be larger for strong ties than weak 
ties. We find that this is the case, both in terms of risk ratio and risk difference (i.e., 
average treatment effect on the treated). Figure [8] displays the click and like risk ra- 
tios for different values of measured tie strength. These risk ratios increase with tie 
strength. For example, consider ad-user pairs with W l3 = and Wij = 0.045 (the 90th 
percentile). The stronger tie ad-user pairs have a larger click risk ratio (risk ratio dif- 
ference of 0.083, CI = [0.014, 0.160]) and a larger like risk ratio (risk ratio difference 
of 0.151, CI = [0.036, 0.280]). That is, the relative increase from the social cue is larger 
for stronger ties, even though the denominator of this ratio — the response probability 
without the social cue — is also larger for stronger ties. 

7. CONCLUSION 

We summarize the primary contributions of this work as follows. First, we rigorously 
measure social influence via social cues on an economically relevant form of user be- 
havior. We construct the average cue-response function, which gives the relationship 
between the number of social signals received by the individual and average rates of 
response. The shape and slope of the cue-response function differ dramatically from 
the naive observational estimates of social influence effects obtained through simple 
conditioning on the number of peers; this difference illustrates the utility of experi- 
mentation in estimating peer effects. Second, we demonstrate the substantial conse- 
quences of including minimal social cues in advertising. This highlights that the most 



8 Other related model specifications yield qualitatively similar results. Specifically, models also including 
a three-way product interaction of Di a , q(Ci.), and f(Wij) resulted in very similar fits. Models with only 
a linear term for tie strength Wij , rather than a natural spline, have a statistically significant interaction 
between tie strength and the cue, but suffered from model bias since the true relationship is non-linear on 
the logistic scale. 

9 For both responses, we fit the model separately to each of the R = 500 bootstrap replicates. Confidence 
intervals are computed as the 2.5 and 97.5 percentiles of the bootstrap distribution of predicted response 
rates. 
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Fig. 7. Estimated average response as a function of tie strength between the user and the single affiliated 
peer. Action rates increase with tie strength both in the presence (D = 1, solid) and absence (D = 0, dashed) 
of the minimal social cue featuring the affiliated peer. Each plot shows model fits (via Equation]!) for users 
at the median total communication count (i.e., q(Ci,) = 0.5), ranging from zero to the 90th percentile of tie 
strength. Shaded regions are 95% bootstrapped confidence intervals of the predicted response rate, which 
are generated by fitting the model to _R = 500 bootstrap replicates of the data. 
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Fig. 8. Estimated risk ratio of clicking and liking as a function of measured tie strength from the model 
in Equation [l] Individuals with an affiliated peer with whom they communicate with more often have a 
higher relative increase in the probability of each response. Shaded regions are 95% bootstrapped confidence 
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subtle of forms of personalized social signals can play an important role in determining 
consumer responses to advertising, above and beyond correlations due to homophily 
Third, we measure the positive relationship between a consumer's response and the 
strength of their connection with an affiliated peer. This relationship exists even when 
social cues are absent from advertisements. Furthermore, cues have a stronger effect 
for stronger ties. These results suggest that social advertising systems can benefit from 
incorporating tie strength measures into the selection of ads and social cues. Finally, 



we hope that the explicit analysis of causal relationships in social advertising will aid 
researchers and decision-makers to understand recent developments in marketing. 

The present work has important limitations that suggest directions for future re- 
search. First, tie strength as a theoretical construct has been given multiple definitions 
and is operationalized in many ways. We used transactional data about communica- 
tion behavior as a measure of tie strength. Our choice of measure provides a readily 
interpretable and applicable measure, but limited some analyses to consumers with 
sufficient levels of communication activity, and future work could attempt to replicate 
our results for other measurements of tie strength, including trust and intimacy. Sec- 
ond, we could not randomize the tie strength of the peers who were affiliated with and 
referred to in the social cues. In particular, the population of ad-user pairs is differ- 
ent for strong and weak ties, so the analysis of Experiment 2 did not directly allow 
for causal inference about the effects of changes to tie strength of peers in social cues. 
Third, we have only examined two methods for presenting social cues with online ad- 
vertising. The minimal social cue we examined in Experiment 2 is appealing in that 
it allows us to attribute its affects to social influence processes, rather than simply 
increasing the size or general visual characteristics of the ad. However, many other 
ways of presenting social information to consumers are possible. For example, a more 
prominent display of peers' association or activity around an entity, combined with an 
advertiser-generated creative, may have a stronger response than any one of the two 
units on their own. In addition, future work may examine the effectiveness of such ad 
displays, as well the impa ct of social signals on other outcomes, such as ad recall and 
attitudes towards brands |Gibs an d Bruicl T2~010) . Finally, it is important to note that 
we only estimate average effects over the population of Facebook users that naturally 
see ads with social context. Individual responses to cues may vary substantially from 
user to user, and further work is needed to understand how factors such as age, gender, 
number of friends, or activity on site relate to the effect of social cues. 
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